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^ '. Abstract 

We discuss different interpretations of Tsallis functional in astrophysics. In principle, for 
t — > +oo, a self-gravitating system should reach a statistical equilibrium state described by the 
Boltzmann distribution. However, this tendency is hampered by the escape of stars and the 
gravothermal catastrophe. Furthermore, the relaxation time increases almost linearly with the 
number of particles N so that most stellar systems are in a collisionless regime described by the 
Vlasov equation. This equation admits an infinite number of stationary solutions. The system 
can be trapped in one of them as a result of phase mixing and incomplete violent relaxation and 
remains frozen in this quasi-stationary state for a very long time until collisional effects finally come 
into play. Tsallis distribution functions form a particular class of stationary solutions of the Vlasov 
equation named stellar polytropes. We interpret Tsallis functional as a particular H- function in 
the sense of Tremaine, Henon and Lynden-Bell [Mon. Not. R. astr. Soc. 219, 285 (1986)]. Fur- 
i— i' thermore, we show that the criterion of nonlinear dynamical stability for spherical stellar systems 

■ described by the Vlasov-Poisson system resembles a criterion of thermodynamical stability in the 

■ microcanonical ensemble and that the criterion of nonlinear dynamical stability for barotropic stars 
described by the Euler-Poisson system resembles a criterion of thermodynamical stability in the 

| canonical ensemble. Accordingly, a thermodynamical analogy can be developed to investigate the 

nonlinear dynamical stability of barotropic stars and spherical galaxies but the notions of entropy, 
free energy and temperature are essentially effective. This analogy provides an interpretation of 
the nonlinear Antonov first law in terms of ensemble inequivalence. Similar ideas apply to other 
systems with long-range interactions such as two-dimensional vortices and the HMF model. We 
propose a general scenario to understand the emergence of coherent structures in long-range sys- 
tems and discuss the dynamical/thermodynamical "duality" of their description. We stress that 
the thermodynamical analogy that we develop is only valid for systems whose distribution function 
depends only on energy. We discuss two other, independent, interpretations of Tsallis functional 
in astrophysics, in relation with generalized kinetic equations and quasi-equilibrium states of col- 
.£h ! lisional stellar systems. 
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I. INTRODUCTION 



For t — > +00, a self-gravitating system is expected to achieve a statistical equilibrium 
state described by the Boltzmann distribution. This statistical approach is the correct de- 
scription of globular clusters, which are small groups of stars (N ~ 10 6 ) whose age is of 
the same order as the relaxation time. Their observed thermal distribution (Michie-King 
models) is the natural outcome of a "collisional" relaxation due to the development of stel- 
lar encounters. This collisional relaxation is usually described by the gravitational kinetic 
Landau equation which satisfies a H-theorem for the Boltzmann entropy. Fundamentally 
the Boltzmann entropy is equal to the logarithm of disorder where the disorder measures 
the number of microstates (complexions) associated with a given macrostate. The max- 
imization of the Boltzmann entropy at fixed mass and energy has a clear statistical and 
thermodynamical meaning: it determines the most probable distribution of stars at equilib- 
rium, assuming that the microstates are equiprobable. However, unlike ordinary systems, 
the statistical mechanics of self-gravitating systems encounters some difficulties due to the 
long-range unshielded nature of gravity and the divergence of the potential at short dis- 
tances [1, 2]. In particular, there is no statistical equilibrium state in a strict sense: the 
Boltzmann entropy has no global maximum and isothermal distributions have infinite mass 
[3]. The increase of entropy as the system spreads reflects the natural tendency of stellar 
clusters to evaporate (this is already the case for a classical gas, without gravity, if it is not 
confined by the walls of a container). A statistical equilibrium state can be defined only 
in a weaker sense if the system is tidally truncated or confined by the pressure exerted by 
an external medium. Theorists overcome the infinite mass problem by confining the system 
within a box. Physically, the box delimits the region of space where the system can be 
assumed isolated and described by thermodynamical arguments. Typically, the box radius 
plays the same role as the tidal radius. However, even for box-confined systems, statistical 
equilibrium does not exist if the energy is too low. Below the Antonov threshold [4], the 
system undergoes gravitational collapse called gravothermal catastrophe [5]. This core col- 
lapse ultimately leads to the formation of binaries [6]. Statistical equilibrium states exist at 
sufficiently high energies. They are metastable (local entropy maxima) but their lifetime is 
considerable as it increases exponentially rapidly with the number of particles [7]. Therefore, 
small clusters of stars such as globular clusters correspond to long-lived metastable states. 
Furthermore, for self-gravitating systems, statistical ensembles are non-equivalent [1, 8] and, 
for isolated systems, only the microcanonical ensemble makes sense. To our opinion, the 
evaporation of stellar clusters, the gravothermal catastrophe, the formation of binaries and 
the long-lived metastability of globular clusters are the correct answers to the absence of 
strict statistical equilibrium for self-gravitating systems. They correspond to important 
physical processes that have been clearly identified in astrophysics. With these limitations 
in mind, self- gravitating systems can be described by conventional statistical mechanics [1, 2]. 

However, for systems with long-range interactions, the collisional relaxation time is ex- 
tremely long because it increases algebraically with the number N of particles. For example, 
for stellar systems, the Chandrasekhar relaxation time scales as t re i ax ~ (N/ In N)to, where 
to is the dynamical time. Therefore, for a very long period, encounters between stars are 
negligible and the galactic dynamics is described by the Vlasov, or collisionless Boltzmann, 
equation coupled to gravity via the Poisson equation [2, 3]. The Vlasov- Poisson system is 
the correct description of large groups of stars such as elliptical galaxies (N ~ 10 12 ) that are 
still, at the present time, in the collisionless regime (contrary to globular clusters). Now, 
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the Vlasov equation admits an infinite class of stationary solutions. Along its collisionless 
evolution, a stellar system can be trapped in one of these stationary solutions and remain 
frozen in that state for a very long time, until collisional effects come into play. Physically, 
the convergence to a steady state is due to phase mixing and incomplete violent relaxation 
[2, 9, 10]. These steady states, referred to as quasi-stationary states or metaequilibrium 
states, are described by non-standard (non-Boltzmannian) distributions /(r, v). This is not 
really surprising since the system is collisionless so that there is no relation with thermo- 
dynamics in the usual sense. Tsallis distributions f q (r, v) [11] form a particular class of 
stationary solutions of the Vlasov equation. In fact, these distributions are known for a long 
time in astrophysics. They are called stellar polytropes and were introduced by Plummer [12] 
in 1911 and Eddington [13] in 1916. Although these distributions have interesting mathe- 
matical properties and have been used to construct simple theoretical models of galaxies [3] , 
it is important to note that they do not provide a good fit of observed galaxies. Once again, 
this is not really surprising: there is no fundamental reason why polytropic distributions 
(or Tsallis distributions) should be selected among other stationary solutions of the Vlasov 
equation [8, 14]. Any distribution function /(r, v) = /(e), where e = v 2 /2 + $(r) is the 
stellar energy, is a stationary solution of the Vlasov equation. It extremizes a functional of 
the form S[f] = — J C(f)d 3 rd 3 v, where C is convex, at fixed mass M and energy E. Such 
functionals have been called H-functions by Tremaine, Henon & Lynden-Bell [15]. Tsallis 
functional S q [f] is the H-function associated with stellar polytropes [8]. Furthermore, the 
maximization of a H-function at fixed mass and energy provides a criterion of nonlinear 
dynamical stability for the Vlasov equation [8, 15, 16, 17]. This "dynamical interpretation" 
defended by [18] and [8, 19] who view metaequilibrium states as stationary solutions of the 
Vlasov equation and interpret the maximization of a iJ-function as a condition of nonlin- 
ear dynamical stability is different from the "generalized thermodynamical interpretation" 
defended by [20, 21, 22, 23, 24, 25, 26, 27, 28] who view Tsallis functional S q [f] as a gener- 
alized entropy, interpret quasi-stationary states as generalized maximum entropy states and 
consider the maximization of S q [f] as a condition of generalized thermodynamical stability 
[52]. 

There are two points that we would like to emphasize in this paper. The first point is 
that Tsallis (and Boltzmann) distributions do not have a fundamental importance in regard 
with the collisionless dynamics of stellar systems (when the N — > +oo limit is taken before 
the t — > +oo limit). These are just particular stationary solutions of the Vlasov equation 
[8, 14]. This is different from the Boltzmann distribution in regard with the collisional 
dynamics of stellar systems (when the t — > +oo limit is taken before the N — > +oo limit). 
The Boltzmann distribution is of fundamental importance as it describes the statistical 
equilibrium state of the system (up to all the limitations mentioned in the first paragraph). 
Furthermore, it is the unique stationary solution of the kinetic Landau equation which 
describes the collisional relaxation of stellar systems to order 1/N [29]. Thus, the first order 
correction to the Vlasov limit selects the Boltzmann distribution. The second point that 
we want to emphasize is that, formally, the criterion of nonlinear dynamical stability for 
collisionless stellar systems described by the Vlasov-Poisson system resembles a criterion 
of generalized thermodynamical stability in the microcanonical ensemble. Therefore, we 
can develop an effective thermodynamical formalism (E.T.F) to investigate the nonlinear 
dynamical stability of collisionless stellar systems [8, 14]. In this thermodynamical analogy, 
the notions of entropy, free energy and temperature are effective. We stress that our E.T.F. 
has a meaning different from the one given by [20, 21, 22, 23, 24, 25, 26, 27, 28]. In our point 
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of view, Tsallis functional S q [f] is related to dynamics, not thermodynamics, in the case of 
collisionless stellar systems. What we do essentially is to use the language of thermodynamics 
to study nonlinear dynamical stability problems. We stress that the "thermodynamical 
analogy" that we develop is only valid for distribution functions of the form f — f(e) with 
/'(e) < that describe a sub-class of spherical stellar systems [3]. We have also found that, 
formally, the criterion of nonlinear dynamical stability for barotropic stars described by the 
Euler-Poisson system resembles a criterion of thermodynamical stability in the canonical 
ensemble [8] . Since "canonical stability implies microcanonical stability in thermodynamics" , 
we deduce, using our thermodynamical analogy, that "the stability of a barotropic star 
implies the stability of the corresponding stellar system (but not the converse)". This 
provides an original interpretation of the nonlinear Antonov first law in terms of ensemble 
inequivalence [8]. 

Tsallis distributions can also arise in other domains of physics and astrophysics for differ- 
ent reasons. For example, polytropic distributions correspond to the unique stationary state 
of a certain class of generalized kinetic equations or generalized Fokker-Planck equations sat- 
isfying a H-theorem for the Tsallis entropy (or free energy) [30, 31, 32]. However, it is not 
clear at the present time to which physical systems these generalized kinetic equations apply. 
We have argued that they may be "effective equations" trying to take into account "hidden 
constraints" in complex systems [14]. We have also shown that it is possible to formally gen- 
eralize kinetic and Fokker-Planck equations, so that they increase an arbitrary entropy [14], 
not necessarily the Boltzmann or the Tsallis one. In a different context, Taruya & Sakagami 
[33] have shown that the collisional evolution of stellar systems, between the phase of violent 
relaxation and the phase of gravothermal catastrophe, can be described by a sequence of 
polytropic distributions with a time varying index, interpreted as quasi- equilibrium states. 
In conclusion, Tsallis distributions (and other non-standard distributions) arise in different 
domains of physics (biology, economy,...) for reasons that are not necessarily related to 
thermodynamics. The important point is to explain, in each specific situation, what is the 
physical meaning of such distributions. We shall give here various examples in astrophysics 
but the concepts that we discuss can apply to other systems with long-range interactions. 



II. BAROTROPIC STARS 

A. The Euler-Poisson system 

We consider a self-gravitating gaseous medium described by the Euler-Poisson system 

|| + V.(pu) = 0, (1) 

+ (u • V)u = — Vp - V$, (2) 

ot p 

A$ = AirGp. (3) 

We assume that the gas is barotropic with an equation of state p = p(p). This provides the 
simplest model of stars [34]. The total energy of the star is 

W[p, u] = fpfj^- dp'dh + l -Jp^dh + Jp^ dh. (4) 
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The first term is the work —p(p)d(l/p) done in compressing it from infinite dilution, the 
second term is the gravitational energy and the third term is the kinetic energy associated 
with the mean motion. It is straightforward to verify that the energy functional (4) is 
conserved by the Euler-Poisson system (VV = 0). Therefore, a minimum of W at fixed 
mass determines a stationary solution of the Euler-Poisson system which is nonlinearly 
dynamically stable [35]. Physically, this means that a small perturbation remains close (in 
some norm) to the minimum. We are led therefore to consider the minimization problem 

Min{W[p,u] \M[p} = M}. (5) 

This minimization problem is consistent with the phenomenology of star formation. A star 
forms through the gravitational collapse of a molecular cloud until it has reached a state of 
minimum energy. Canceling the first order variations of Eq. (4), we obtain u = and the 
condition of hydrostatic equilibrium 

Vp = -pV$, (6) 

between pressure and gravity. Therefore, extrema of W correspond to stationary solutions 
of the Euler-Poisson system (l)-(3). Combining the condition of hydrostatic equilibrium (6) 
and the equation of state p = p(p), we get 

*/ = -., (7) 

so that p is a function of <£> that we note p = p($). Considering now the second order 
variations, the condition of nonlinear dynamical stability is 

S 2 W = I J 5p5<$> dh + J 4^(M 2 d 3 r > 0, (8) 

for all perturbations that conserve mass, i.e. J 5pd 3 r = 0. We note that the second integral 
in Eq. (8) can be written in a more conventional form by using p'(p)/p = — l/p'($). The 
minimization problem (5) has been studied in detail in [8, 36, 37] for spherically symmetric 
systems described by an isothermal and a polytropic equation of state (the system can be 
self-confined or confined by a box or by an external pressure). It is shown that the point 
in the series of equilibria where the system ceases to be a minimum of W and becomes a 
saddle point coincides with the point of neutral linear stability. Therefore, the conditions of 
linear and nonlinear dynamical stability coincide. 



B. Isothermal and polytropic stars 

In the theory of stellar structure, it is usually assumed (at least in the simple models that 
we consider here) that a star is a perfect gas in local thermodynamic equilibrium (L.T.E). 
Therefore, at each point, the distribution function of the particles is of the form 



/(r,v) 



m 



3/2 



27rfc B T(r) 



m[v — u(r)] z 



(9) 
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If we define the pressure by p = | J fw 2 d 3 v where w = v — u(r), we find that the local 
equation of state is 

p(r) = P -^k B T{v). (10) 

We shall now consider two types of models that have been widely studied in astrophysics, 
namely the case of isothermal stars and the case of polytropic stars. 

(i) Isothermal stars: If we assume that the star is in thermal equilibrium, then the 
temperature is uniform: T(r) = T. From one place to the other the transformation is 
isothermal. In that case, the equation of state becomes 

p(r) = P -^k B T. (11) 
m 

Since the pressure depends only on the density, the fluid is barotropic. The energy functional 
(4) reads 

W\p, u] = k B T [ ^\n^d 3 r+- [ p$ d 3 r + I p— d 3 r. (12) 
J m m 2 J J 2 

We note that the energy functional (12) of an isothermal gas coincides with the Boltzmann 
free energy F B = E — TS B of a self-gravitating system in the canonical ensemble (see [36] 
for more details). Furthermore, the distribution function of the particles is the Maxwell- 
Boltzmann distribution (with a uniform temperature). The relation (7) between the density 
and the potential can be explicitly written 



p = A'e «bt. (13) 

According to Eq. (5), it can be obtained by extremizing Eq. (12) at fixed mass or by com- 
bining the condition of hydrostatic equilibrium with the isothermal equation of state. 

(ii) Polytropic stars: Stars are not isothermal in general. In the convective region, they are 
rather in a situation where the entropy is uniform: s(r) = s. From one place to the other the 
transformation is isentropic. In that case, using the first principle of thermodynamics du = 
—pdv + Tds with ds = and du = c v dT, we obtain the differential equation c v dT + pdv = 
(with v = m/p). Using the equation of state of a perfect gas p = ^k B T and the Mayer 
relation c p — c v = k B , the differential equation can be integrated and yields the polytropic 
equation of state 

p(r) = Kp(r)\ (14) 

where K is the polytropic constant and 7 = c p /c v is the ratio of specific heats at constant 
pressure and constant volume [34]. The polytropic index n is defined by 7 = 1 + \ jn. The 
polytropic constant can be written K = k B Q 7 /m, where 6 7 is sometimes called a polytropic 
temperature (cf. [34], p. 86). For n — > +00, we recover the isothermal case with 7 = 1 and 
7 = T. For a polytropic gas, the local temperature T(r), defined by (10), is given by 



m 



Kp(vY' n . (15) 



We note that the temperature is position dependent (while the specific entropy s is uniform) 
and related to the density by a power law; this is the local version of the usual isentropic 
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law TV"' 1 = Cst. in standard thermodynamics. The polytropic index n is related to the 
gradients of temperature and density according to 

VlnT = -Vlnp. (16) 

n 

The energy functional (4) can be written 

w ^ u l = 7TI - p) dh + \j p$ dh + j p Y dh - (17) 

For an isentropic transformation (ds = 0), the first term in Eqs. (4) and (17) represents 
the internal energy since du/m = —pd(l/p). For the polytropic equation of state (14), 
the internal energy is a power-law functional: U = K/{^ — 1)/ p~ / d 3 r. We have then 
added a constant term K/(j — 1) J pd 3 r, proportional to the total mass, in the polytropic 
energy functional (17) so as to recover the isothermal energy functional (12) for 7 — > 1 (i.e., 
n — > +00). Using Eq. (7) or extremizing the energy functional (17) at fixed mass, we find 
that the relation between the density and the potential is 



P 



(18) 



We see at this stage some resemblances with Tsallis distributions and free energies, see 
Eqs. (18) and (17). However, there is no generalized thermodynamics in the problem. The 
physics of gaseous stars can be understood in terms of conventional thermodynamics once 
realized that adiabatic transformations are more relevant than isothermal transformations 
in stellar structure. We shall see that these formal resemblances are essentially fortuitous 
or the mark of a thermodynamical analogy. 



III. STELLAR SYSTEMS 

A. The statistical equilibrium state 

For t — > +00, a self-gravitating system is expected to achieve a statistical equilibrium 
state. Assuming that the accessible microstates are equiprobable, the most probable macro- 
scopic distribution function maximizes the Boltzmann entropy 

S B [f] = - [ ^ln^-rf 3 rrf 3 v, (19) 
J m m 

at fixed mass and energy. The Boltzmann entropy can be obtained by a standard combina- 
torial analysis. The criterion of thermodynamical stability is therefore 

Max^/] I E[f] = E, M[f] = M}. (20) 

It determines the most probable distribution of stars at statistical equilibrium. Introducing 
Lagrange multipliers and writing 5S — f35E — a5M = 0, we get the Boltzmann distribution 

f = Ae' 13 ™. (21) 
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We note that the statistical equilibrium state depends only on the energy e = v 2 /2 + $(r) of 
the stars (for a non- rotating system). The collisional evolution is usually described by the 
kinetic Landau equation, see e.g. [29], that we write symbolically as 

% + v-^ + F.^- = Q Landau (f), (22) 

where F = — V$ is the self-consistent gravitational field produced by the stars and Qiandau 
is the Landau collision term. The Landau-Poisson system conserves mass and energy and 
increases the Boltzmann entropy (H-theorem). The Boltzmann distribution is the only sta- 
tionary solution of this equation [53] . From the kinetic theory of stellar systems, we can show 
that the collisional relaxation time (Chandrasekhar's time) scales as t re i ax ~ (N/ In N)tjj. 



B. The Vlasov-Poisson system 

For t <C (N/ In N)to, we can ignore the collision term in the kinetic equation. In this 
regime, a stellar system is described by the Vlasov-Poisson system 

df df df 



J fd 3 v. (24) 



A$ = AnG j f d 3 v. 

The Vlasov description assumes that the evolution of the system is encounterless. This 
is a very good approximation for the dynamics of stars in elliptical galaxies (N ~ 10 12 ). 
For smaller groups of stars, such as globular clusters (N ~ 10 6 ), encounters have to be 
taken into account and the dynamics is governed by the Landau-Poisson system or by the 
orbit averaged Fokker-Planck equation [3]. Here, we exclusively focus on the collisionless 
dynamics. It is thus clear from the beginning that thermodynamics, in its usual sense, is 
irrelevant to the present context; it makes sense only on much longer timescales when stellar 
encounters have to be taken into account. The Vlasov equation admits an infinite number 
of stationary solutions [3]. During its collisionless evolution, a stellar system can be trapped 
in a stable stationary state and remains frozen in that quasi-stationary state for a very 
long time (until collisions come into play and drive the slow relaxation). According to the 
Jeans theorem, the general form of stationary solutions of the Vlasov equation is a function 
/ = f(Ii, I n ) of the integrals of motion. Of course, only stable stationary solutions are 
of physical interest. In the general case, it is difficult to derive a criterion of dynamical 
stability. We shall restrict ourselves in this paper to stationary distribution functions of the 
form f — f{e) which depend only on the energy of the stars e = \ + $(r). Such distribution 
functions describe a sub-class of spherical stellar systems (in the general case, / depends 
on energy e and angular momentum j = rxv) [3]. For such distributions, it is possible to 
derive a general criterion of nonlinear dynamical stability. 
We consider the class of functionals 

S[f] = - J C(f) dhd 3 v, (25) 

where C is an arbitrary convex function. These functionals are called H-functions [15] 
because they share some analogies with the Boltzmann H-function in kinetic theory (see 



8 



the Conclusion) [54]. Since these functionals are particular Casimirs, they are conserved by 
the Vlasov equation. The total energy E — | J fv 2 d 3 rd 3 v + | f pQd 3 r and the total mass 
M[f] = J fd 3 rd 3 v are also conserved by the Vlasov equation. Therefore, a maximum of S at 
fixed mass M and energy E determines a stationary solution /(r, v) of the Vlasov equation 
that is nonlinearly dynamically stable. We are led therefore to consider the maximization 
problem 

Max{S[/] | E[f] = E, M[f] = M}. (26) 

We note that F[f] = E[f]—TS[f], where T is an arbitrary positive constant, is also conserved 
by the Vlasov equation (this is called an energy- Casimir functional [35]). Therefore, a 
minimum of F at fixed mass M is also a nonlinearly dynamically stable stationary solution 
of the Vlasov equation. This criterion can be written 



where 



Min{F[/] |M[/] = M}, (27) 

F[f] = ^ f v 2 d 3 rd 3 v + ^ J p^dh + T J C{f)d 3 rd\. (28) 

Similar criteria of nonlinear dynamical stability have been introduced in the context of 
two-dimensional hydrodynamics described by the 2D Euler-Poisson system [40]. The opti- 
mization problem (27) corresponds to the nonlinear dynamical stability criterion of Holm 
et al. [35] and the optimization problem (26) corresponds to the refined dynamical stability 
criterion of Ellis et al. [40]. These criteria are in general not equivalent for systems with 
long-range interactions, and this is similar to a notion of ensemble inequivalence in thermo- 
dynamics (see Sec. Ill C). Inspired by these studies, we have introduced the same criteria to 
study the nonlinear dynamical stability of stellar systems described by the Vlasov-Poisson 
system [8] . Recently, we found that similar optimization principles have also been introduced 
independently by Rein and Guo in the mathematical literature, see [17]. 

Introducing Lagrange multipliers and writing SS — f35E — a5M = or 8F — a5M = 0, 
we find that the critical points of the variational problems (26) and (27) are both given by 

C'(f) = -0e - a. (29) 

Since C is a monotonically increasing function of /, we can inverse this relation to obtain 
/ = F(f3e + a) where F(x) = (C") _1 (— x). Therefore, the optimization problems (26) and 
(27) determine stationary solutions of the Vlasov equation of the form f = f(e). As said 
previously, this is a particular case of the Jeans theorem describing a sub-class of spherical 
stellar systems [3]. From the identity /'(e) = —f3/C"{f) resulting from Eq. (29), /(e) is a 
monotonic function. Assuming that / is decreasing, which is the physical situation, imposes 
P — 1/T > 0. Setting J = S — (3E, the condition of nonlinear dynamical stability provided 
by the criterion (26) is 



5 2 J = - 



j C "(f)^^d 3 rd\-^ J 5 P 5^d 3 v < 0, 

V8f | 5E = 5M = 0, (30) 



and the condition of nonlinear dynamical stability provided by the criterion (27) is 
S 2 -J=-J C"(f)^d 3 rd 3 v-^P J 5p5^d 3 r<0, 



V6f ; 5M = 0. (31) 
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The first integral can be written in a more conventional form by using /'(e) = —/3/C"(f). 
We note the importance of the first order constraints in the criteria (30) and (31). If 
condition (31) is satisfied for all perturbations that conserve mass, it is a fortiori satisfied for 
perturbations that conserve mass and energy. Therefore, condition (31) implies condition 
(30), but not the opposite. We conclude that the stability criterion (26) is more refined 
than the stability criterion (27): if a collisionless stellar system satisfies (26) or (27), it is 
nonlinearly dynamically stable; however, if it does not satisfy (27), it can be nonlinearly 
dynamically stable provided that it satisfies (26). This means that we can "miss" stable 
solutions if we use just the optimization problem (27). The problem (26) is richer and allows 
to construct a larger class of nonlinearly dynamically stable models. In particular, complete 
stellar polytropes with index 3 < n < 5 satisfy the criterion (26) but not the criterion (27) 
[8]. 



C. Thermodynamical analogy 

To study the nonlinear dynamical stability of a collisionless stellar system described by 
a distribution function of the form / = /(e) with /'(e) < 0, we are led to consider the 
optimization problems (26) and (27). We note that, formally, they are similar to criteria 
of thermodynamical stability for collisional self-gravitating systems, see Eq. (20), but they 
involve a more general functional S[f] = — J C(f) d 3 rd 3 v (H-function) than the Boltzmann 
entropy (19). Furthermore, they have a completely different interpretation as they provide 
criteria of nonlinear dynamical stability for a stationary solution of the Vlasov equation 
(representing a quasi-stationary structure in the collisionless regime) while the maximization 
of the Boltzmann entropy at fixed mass and energy provides a condition of thermodynamical 
stability for the statistical equilibrium state reached for t — > +oo (representing the most 
probable state that we may expect). 

Due to the formal resemblance between the nonlinear dynamical stability criteria and 
the thermodynamical stability criteria, we can develop a thermodynamical analogy [8, 14] to 
investigate the nonlinear dynamical stability of collisionless stellar systems with / = /(e) and 
/'(e) < 0. In this analogy, S plays the role of an "effective entropy" , T — 1/(3 plays the role of 
an "effective temperature" and F plays the role of an "effective free energy" (it is related to 
S by a Legendre transform). The criterion (26) is similar to a condition of "microcanonical 
stability" and the criterion (27) is similar to a condition of "canonical stability". Since 
canonical stability implies microcanonical stability (but not the converse), we recover the 
fact that condition (31) implies condition (30). The stability problems (26) and (27) can be 
studied by plotting the linear series of equilibria (3(E), which is similar to a caloric curve in 
thermodynamics. According to Poincare's theorem, a mode of stability is lost or gained at a 
turning point or at a branching point. Linear series of equilibria have been studied in detail 
in relation with the thermodynamics of self-gravitating systems for the Boltzmann [5, 41] 
and Fermi-Dirac [42] entropies. Due to the above thermodynamical analogy, the method of 
linear series of equilibria can be used similarly to settle the nonlinear dynamical stability of 
a collisionless stellar system for a general iJ-function. Note that the slope dE/dT (where 
f3 = 1/T is the Lagrange multiplier associated with the energy) plays an important role 
because, according to the turning point argument, its change of sign is the signal of an 
instability. In thermodynamics, C = dE/dT represents the specific heat. Isothermal self- 
gravitating spheres cease to be minima of free energy when dE/dT becomes negative passing 
by C = +oo, and they cease to be maxima of entropy when dE/dT becomes positive again 
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1.2 




1 1 1 1 1 1 1 1 1 

-2-10 1 2 

-(ENERGY) 

FIG. 1: Series of equilibria for polytropic spheres with index n = 4 [8, 32, 37]. In the thermo- 
dynamical analogy, this can be viewed as an effective caloric curve giving the effective inverse 
temperature n = (M/4ir)(4:irG/K(n + l))"/( n_1 )/i?( n_3 )/( n_1 ) [which is a monotonic function of 
the Lagrange multiplier 0\ as a function of energy A = —ER/GM 2 . Complete polytropes (with 
compact support) are indicated by (•). Since they lie after the turning point of "temperature" 
and before the turning point of energy, in the thermodynamical analogy, they are unstable in 
the "canonical" ensemble (saddle points of "free energy" F at fixed M) but stable in the "mi- 
crocanonical" ensemble (maxima of "entropy" S at fixed E,M). Due to the correspondence that 
we have found (see Sec. HID), these effective thermodynamical stability criteria mean in reality 
that stellar polytropes with n = 4 are nonlinearly dynamically stable stationary solutions of the 
Vlasov-Poisson system but polytropic stars with n = 4 are linearly dynamically unstable stationary 
solutions of the Euler-Poisson system. This is similar to a situation of "ensemble inequivalence" in 
thermodynamics. In particular, complete polytropes with n = 4 lie in a region of effective negative 
specific heats C < 0. 

passing by C = [41] [36]. Therefore, the criteria of canonical and microcanonical stability 
are inequivalent in the region of negative specific heats C < 0. Due to the thermodynamical 
analogy, we have similar results for the nonlinear dynamical stability of collisionless stellar 
systems (for an arbitrary H-function) but with a different interpretation. For example, the 
series of equilibria for polytropic distributions has been studied in [8, 32, 37]. In this context, 
the sign of the slope dE/dT, which is similar to an effective specific heat, is connected to the 
nonlinear dynamical stability of the system (see Fig. 1). This "dynamical interpretation" 
[8, 32, 37] is different from the "generalized thermodynamical interpretation" of Taruya 
& Sakagami [22] who considered the same mathematical problem in relation with Tsallis 
generalized thermodynamics. 



11 



D. A new interpretation of the Antonov first law 

For any spherical stellar system with / = /(e), there exists a corresponding barotropic 
star with the same equilibrium density distribution. Indeed, defining the density and the 
pressure by p = J fd 3 v = p($), P = \ j fv 2 d 3 v = p(<E»), and eliminating the potential <3> 
between these two expressions, we find that p = p(p). Writing explicitly the density and 
the pressure in the form p = An J^°° f(e)y/2(e - ®)de and p = J^°° /(e) [2(e - $)] 3/2 <ie, 
and taking the derivative of the second equation, we obtain the condition of hydrostatic 
equilibrium (6). As discussed in Sec. Ill A, the minimization principle (27) provides a 
sufficient condition of nonlinear dynamical stability for a collisionless stellar system. To 
solve this minimization principle, we can first minimize F[f] at fixed density p(r) to obtain 
/*(r, v). We can then express the functional F[f] as a functional of the density p(r) by 
setting F[p\ = F[f*}. The calculations are detailed in [8] and the functional F[p] can be 
finally written 

F[P\ = \ J P* d 3 r + J p £ ^ dp'd\ (32) 

where p(p) is the equation of state of the corresponding barotropic gas. We are now led to 
consider the minimization problem 

Min {F[p} | M[p] = M}. (33) 

Now, we observe that the functional (32) coincides with the energy functional (4) of a 
barotropic gas with u = 0. We arrive therefore at the following conclusion: for a given 
stellar system with / = /(e) and /'(e) < 0, if we know that the corresponding barotropic 
star is nonlinearly dynamically stable with respect to the Euler-Poisson system, then it is 
a minimum of W[p, u], hence of F[p] (at fixed mass). Therefore, the stellar system satisfies 
the criterion (27) so it is nonlinearly dynamically stable with respect to the Vlasov-Poisson 
system. This leads to a nonlinear generalization of the Antonov first law: "a stellar system 
is nonlinearly dynamically stable whenever the corresponding barotropic gas is nonlinearly 
dynamically stable" [8]. However, the reciprocal is wrong in general. A stellar system can 
be nonlinearly dynamically stable according to the "microcanonical" criterion (26) while 
it does not satisfy the "canonical" criterion (27) so that the corresponding barotropic star 
is dynamically unstable [37]. Due to the thermodynamical analogy, the Antonov first law 
for collisionless stellar systems has the same status as the fact that: "canonical stability 
implies microcanonical stability in thermodynamics". The reciprocal is wrong if the en- 
sembles are not equivalent. To the point of view of their dynamical stability, the crucial 
difference between stars and galaxies is that, for galaxies, both S (H-function) and E are 
individually conserved by the Vlasov equation while in the case of barotropic stars only the 
total energy W is conserved by the Euler equations. Therefore, the most refined stability 
criterion for galaxies is (26) while the most refined stability criterion for stars is (5), which 
is included in (26). This is the intrinsic reason why a spherical galaxy can be stable even if 
the corresponding barotropic star is unstable. 

It is interesting to consider the application of these results to polytropes (see Fig. 1). 
By plotting the series of equilibria (3(E), it can be shown that a complete polytrope (i.e., 
for which the density drops to zero at a finite radius) ceases to be a minimum of F for 
n > 3 [37]. This is when the slope dE/dT becomes negative in the series of equilibria. 
In the thermodynamical analogy, this is similar to a loss of canonical stability. Using the 
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above result, we conclude that polytropic stars are nonlinearly dynamically stable for n < 
3 and they become dynamically unstable for n > 3 [37]. However, complete polytropes 
cease to be a maximum of S only for n < 5 (they also cease to be self-confined at this 
index) [8, 32]. This is similar to a loss of microcanonical stability in the thermodynamical 
analogy. Therefore, stellar polytropes are nonlinearly dynamically stable for n < 5 and they 
become dynamically unstable for n > 5. For 3 < n < 5, stellar polytropes are nonlinearly 
dynamically stable while corresponding polytropic stars are dynamically unstable. This 
is similar to a situation of ensemble inequivalence (in a region of negative specific heats) 
in thermodynamics [43, 44]. Of course, the dynamical stability of stellar polytropes and 
polytropic stars has been established for a long time in astrophysics [3] but the interpretation 
of these results (and of the Antonov first law) in terms of a thermodynamical analogy and a 
situation of ensemble inequivalence is new. Furthermore, only linear dynamical stability is 
considered in [3] while the criteria (26) and (27) are criteria of nonlinear dynamical stability. 
Similar criteria of nonlinear dynamical stability can be developed for the HMF model [18, 19] 
(in that case, the "ensembles" are equivalent) and for other systems described by Vlasov or 
Euler equations [29]. 

E. Isothermal stellar systems 
We consider the if -function 



This functional resembles the Boltzmann entropy (19) in thermodynamics. However, as 
explained above, its physical interpretation is different. Its maximization at fixed mass 
and energy determines a nonlinearly dynamically stable stationary solution of the Vlasov 
equation with distribution function 



This distribution function has the same form (but a different interpretation) as the statistical 
equilibrium state (21) of a stellar system resulting from a collisional relaxation or as the 
distribution function (9) of the gas in an isothermal star. For these reasons, collisionless 
stellar systems described by Eq. (35) are sometimes called isothermal stellar systems and 
T = is sometimes called a "temperature". In fact, it is more proper to regard T 
as the velocity dispersion of the stellar system. We note also that the mass m of the 
individual particles does not appear in the H-function (34) and in the distribution function 
(35) contrary to the case of statistical equilibrium, see (19) and (21). This is because the 
present description is based on the Vlasov equation in which the mass of the particles does 
not appear. Therefore, the distribution function (35) does not lead to a segregation by 
mass contrary to the statistical equilibrium distribution of a multi-species self-gravitating 
system [10]. The barotropic gas associated with the stellar system defined by Eq. (35) is the 
isothermal gas with an equation of state p(r) = p(r)T where T = 1/(3. The functional (32) 
takes the form 




(34) 



(35) 




(36) 
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It coincides with the energy functional (12) of an isothermal star with u = 0. The density 
is related to the potential according to 

p = A'e-P*. (37) 

This relation can be directly obtained by extremizing F[p] at fixed mass. We can express 
the distribution function in terms of the density according to 

/=(^) 3/2 p(r)e"^. (38) 



F. Stellar polytropes 

We consider the if -function 



S = -^T\ J{f q -f)d?rd\. (39) 

It has the same form as the Tsallis entropy in non-extensive thermodynamics [11]. However, 
as explained above, its physical interpretation is different. In the present context, its max- 
imization at fixed mass and energy determines a nonlinearly dynamically stable stationary 
solution of the Vlasov equation, called a stellar polytrope, with distribution function 



./ 



ff(g-l) ' 
/i e 

1 



9-1 

(40) 



The polytropic index is related to the parameter q by 

71=- + —*— . (41) 
2 q-1 V ; 

Stellar polytropes have been introduced by Plummer [12] in 1911. In fact, Plummer did not 
write the distribution function explicitly and analyzed the distribution of stars in globular 
clusters by treating (incorrectly) the system as a gas in convective equilibrium. Plummer's 
law corresponds to the analytical solution of a polytropic gas with index n = 5 found 
by Schuster in 1883. Eddington [13] in 1916 criticized the "adiabatic" model of Plummer 
and justified Plummer's law as a particular solution of the Vlasov equation satisfying the 
Jeans theorem. Eddington was apparently the first to write the distribution function of a 
"stellar polytrope" correctly. Note that the "mistake" of Plummer is interesting because 
it reflects the mathematical property that "for any spherical stellar system with / = /(e) 
there exists (formally) a corresponding barotropic star" [3]. Later on, the fact that polytropic 
distributions (40) maximize a certain Casimir functional at fixed mass and energy, and that 
this maximization problem is related to their dynamical stability with respect to the Vlasov 
equation has been recognized by several authors, e.g. Ipser [16] in 1974. However, in the 
work [16] the functional is simply written as W = — J f 1+1 ^ n ~ 3 ^d 3 rd 3 v. Therefore, when 
n — > +oo, the connection with the functional (34) describing isothermal stellar systems is 
not direct. The functional (39) introduced by Tsallis [11] (albeit in a quite different context) 
is better to make this connection because, using L'Hopital's rule, Eq. (39) reduces to Eq. (34) 
for q — > 1 (or n — > +oo). Similarly, the distribution function written in the form (40) reduces 
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to the distribution function (35) for q — > 1 (or n — > +00). The form given by Eddington [13] 
and by Binney & Tremaine [3] is less convenient to make this connection. Therefore, in the 
context of Vlasov systems, we interpret Tsallis functional as a useful H-function connecting 
continuously stellar polytropes and isothermal stellar systems. 

It is shown in [32] that physical polytropic distribution functions have q > and /3 > 0. 
We need therefore to consider two cases according to the sign of q — 1. For q > 1 (n > 3/2), 
the distribution function can be written 

f = A(a (42) 

where we have set A = [(5{q — l)/q}~ and a = qp/(3(q — 1)- It is valid for v < v max (r) = 
a/2(q; — $(r)). For v > v max (r), we set / = 0. This situation corresponds to the usual 
polytropes considered in astrophysics [3]. For q — > 1 (n — > +00), we recover isothermal 
distributions and for n = 3/2 the distribution function is a step function. This is the 
distribution function of a Fermi gas at zero temperature describing classical white dwarf 
stars [34]. Note that stellar polytropes with 1/2 < n < 3/2 exist mathematically but the 
distribution function /(e) increases with the energy so they may not be physical. The density 
and the pressure can be expressed as 

, = 4^ (a -.)-!»^, (43) 

For < q < 1, the distribution function can be written 

f = A(a + e)^, (45) 

where we have set A = [/3(1 — q)/q}'^ 1 and a = qn/ (3(1 — q). In that case, v max — > +00. 
We shall only consider distributions for which the density and the pressure (first and second 
velocity moments) are defined. This implies 3/5 < q < 1 (i.e., n < —1). Then, the density 
and the pressure can be expressed as 

p = 4nV2A(a + ^r^^, (46) 



P 



_W2X (a + *)-iyMf (47, 



n + 



Eliminating the gravitational potential between the expressions (43)-(44) and (46)-(47) 
giving the density and the pressure, one finds that 

p = Kp\ 7 = 1 + -, (48) 

n 

where 

1 r n r(3/2)r(n- 1/2)1 ~ 1/n , 
K -—A i ^ 2A r(„ + i) } • < n>3 / 2 »- < 49 > 
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K 



n+1 



-l/n 



(n < -1). 



(50) 



Therefore, a stellar polytrope has the same equation of state as a polytropic star. How- 
ever, we stress that they do not have the same distribution function, except for n — > +00 
(isothermal system). The distribution function of the gas in a polytropic star is given by 
the local thermodynamic equilibrium (9) with a space dependent temperature (15) while 
the distribution function of a stellar polytrope is given by (40) which is completely different. 
The functional (32) can be put in the form 

F[p] = l -jp<bdh + j (p^ - p) dh. (51) 

It coincides with the energy functional (17) of a polytropic star with u = 0. Minimizing 
this functional at fixed mass, we directly obtain the relation between the density and the 
potential 



7-1 

. A "V* 



7-1 



(52) 



It resembles Tsallis distribution (in physical space) where 7 plays the role of the g-parameter 
and K plays the role of the temperature (compare Eqs. (40) and (52)). Also, the 
functional (51) resembles Tsallis free energy F[p] = E[p] — KS^[p] in physical space. In this 
sense, Tsallis distributions are "stable laws" since they keep a similar structure as we pass 
from phase space f = /(e) to physical space p = p($) with the correspondence 7 <-> q and 
K <-> This is probably the only class of distributions enjoying this property. However, 
we again emphasize that, in the present context, the resemblance with a thermodynamical 
formalism is essentially fortuitous or effective. 

We can also express the distribution in terms of the density according to 

n-3/2 



/ 



1 

~Z 



l/n _ 



v 2 /2 



(n + l)K 



/-r(3/2)r(n- 1/2) r , xl „ /9 , 
Z = 4nV2 y r (y ; +1) [K(n + 1)] 3/2 , (n > 3/2) 



r(-n)r(3/2) 



-K(n + 1)} 



3/2 



(n < -1) 



(53) 



(54) 



(55) 



T(3/2 - n) 

This is the counterpart of the isothermal distribution function (38). For any stellar system, 
we define the kinetic temperature by f T(r) = \{v 2 ) or p(r) = p(r)T(r). It is proportional to 
the local velocity dispersion of the particles. For a polytropic distribution function 

T(r) = Kp(r) 1/n . (56) 

As indicated previously, for collisionless stellar systems T must be regarded as a mean- 
squared velocity rather than a temperature (the individual mass of the particles never ap- 
pears in the equations). We shall use, however, the temperature terminology. Using Eq. (56), 
the distribution function (53) can be written 

n n-3/2 



f = B r . 



p(r) 



[27rT(r)] 3 / 2 



1 - 



v 2 /2 



[n + l)T(r) 



(57) 
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B "= r ( n- r i/2X,%^ {n> ^ < 58 > 

B " = r ( i) ( Hn7U ( " < - 1) - (59) 

Note that for n > 3/2, the maximum velocity can be expressed in terms of the kinetic 
temperature according to 

v max (r) = v/2(n+l)T(r). (60) 

Using T(z + a)/T(z) ~ z a for z — > +00, we recover the isothermal distribution (38) for 
n — > +00. On the other hand, from Eqs. (56) and (52), we immediately get T(r) = K(X — 
(7 - l)$(r)/X7) so that 

VT = -^^V$. (61) 

7 

This relation can also be obtained directly from Eqs. (42) and (57). This shows that, for a 
stellar polytrope, the kinetic temperature is a linear function of the gravitational potential 
(this is also true for a polytropic gas). The coefficient of proportionality (7 — l)/7 = 
l/(n + 1) = 2(q — l)/(5g — 4) is related to the polytropic index. There is an interesting 
application of this result related to a remark of Eddington [13] . First of all, for isolated stellar 
systems, the energy e max at which the distribution function vanishes should correspond to 
the escape energy e = 0. This implies a = in Eq. (42) which leads to the ordinary DF of 
a polytrope (the distribution (42) with a 7^ is in fact a generalization of the polytropic 
model with e max 7^ 0). Now, a = implies that A = in Eq. (52), see, e.g., Eq. (43). Since 
p and $ must then vanish at the same point, this implies that the density profile must go 
to +00 (with a finite mass) which is only possible for the polytropic index n — 5. This is 
Eddington's interpretation of Plummer's law [13]. On the other hand, for A = 0, we get 
T(r) = — (7 — l)$(r)/7. Defining the local kinetic energy by E kin = \p(v 2 ) = |p(r)T(r) and 
the local potential energy by E pot = we get E kin /E pot = 3T(r)/$(r) = -3(7 - l)/7. 

Thus, a local Virial theorem 2E k i n + E pot = holds for 7 = 6/5, i.e. n — 5. Distribution 
functions satisfying this relation have been called hypervirial models of stellar systems [45] . 



G. Generalized temperatures 

We shall now discuss different notions of "temperature" that emerge in the case of poly- 
tropic distributions. In the case of isothermal distribution functions, all these notions coin- 
cide. However, for polytropic distribution functions they have a different character. 

(i) Lagrange multiplier (3 = 1/Tq\ the Lagrange multiplier (3 appearing in the variational 
principle 5S — (35E — a5M = associated with the optimization problem (26) can be viewed 
as a generalized inverse temperature since (3 = dS/ dE. In terms of this Lagrange multiplier 
f3, a polytropic distribution function can be written 

r g(g-i) ' 



q-l 

(62) 
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As indicated previously, the series of equilibria /3(E) is similar to a caloric curve and the 
slope C = dE/dTo is similar to a specific heat. The sign of C is connected to the nonlinear 
dynamical stability of the system via the turning point argument. This implies that the 
correct "temperature" to use in the definition of C when using it to settle the nonlinear 
dynamical stability of a collisionless stellar system is the inverse of the Lagrange multiplier 
f3. However, T = 1/(3 has generally not the dimension of a temperature. 

(ii) Dimensional temperature: we can define a quantity that has the dimension of an 
inverse temperature by setting b = (3/p((3) (note that the normalization condition M = 
J fd 3 rd 3 v imposes that fi is an implicit function of (3). If we define furthermore A(b) = 
[i(b) 1 / ( - q ~ 1 \ we can rewrite the polytropic distribution function in terms of b as 



/ = A(b) 



i 

9-1 



Therefore, we see that the polytropic distribution satisfies a relation of the form 

/ = A(b)F(be) 



(63) 



(64) 



with F(x) = [1 — {{q — l)/q)x] 1 ^ q ~ 1 \ Not all distribution functions of the form / = 
F(j3e + cx(/3)), coming from the optimization problem (26), can be written as (64). Ponno 
[46] has shown in a different context that only polytropic distribution functions (Tsallis 
q-distributions) satisfy this relation. 

(iii) Polytropic temperature K: we have indicated that the polytropic constant K shares 
some analogies with a temperature and, for this reason, it is sometimes called a polytropic 
temperature. We note, in particular, that K is uniform in a polytropic system, as is the 
temperature in an isothermal system. The distribution function of a stellar polytrope can 
be written in terms of K as 



/ 
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~Z 



p(r 



l/n _ 



v 2 /2 



-i n-3/2 



(n + l)K 



(65) 



We note that, for a stellar polytrope, K is a monotonic function of the Lagrange multiplier 
(3 expressed by Eqs. (49) and (50) so they essentially play the same role. Therefore, it is 
often convenient to use K instead of (3 when we plot the series of equilibria for polytropes 
(this is the convention that we have adopted in [8, 32, 37] and in Fig. 1). 

(iv) Kinetic temperature: For any stellar system, it is natural to introduce a kinetic 
temperature T(r) through the relation §T(r) = \{v 2 ). In general, the kinetic temperature 
is inhomogeneous. The distribution function of a stellar polytrope can be written in terms 
of T(r) as 



f = B 



P( r ) 



n [27rT(r)] 3 / 2 



1 - 



v 2 /2 



[n + l)T(r) 



n-3/2 



(66) 



where T(r) = p{p)/p = Kp{r) 1 ^ 1 . Combined with Eq. (52), this immediately yields the 
relation (61) between the kinetic temperature and the gravitational potential. 

(v) Energy excitation temperature: as indicated in [14], in any system with / = /(e), 
one may define a local energy dependent excitation temperature by the relation 



1 

W) 



din/ 

de 



(67) 
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For the isothermal distribution (35), T(e) coincides with the temperature T = 1/(3. For the 
polytropic distribution (40), T(e) = qp>/(3 — (q — l)e. This excitation temperature has a 
constant gradient 




(68) 



related to Tsallis q parameter (or equivalently to the index n of the polytrope). The other 
parameter \i is related to the value of energy where the temperature reaches zero. Relation 
(68) is similar to that found by Almeida [47] in a different context. 

IV. A SECOND INTERPRETATION: GENERALIZED KINETIC EQUATIONS 

In Sec. Ill, using the orthodox interpretation of astrophysics [3], we have justified the 
polytropic distribution function (40) as a particular stationary solution of the Vlasov equa- 
tion. This is probably the most relevant justification of this distribution function in astro- 
physics since most astrophysical bodies are governed by the collisionless Boltzmann equation. 
In this context, the connection with a thermodynamical formalism is essentially effective 
(thermodynamical analogy). The Tsallis functional S q [f] is a H-function whose maximiza- 
tion at fixed mass and energy provides a criterion of nonlinear dynamical stability. Fur- 
thermore, the polytropic distribution does not play any special role among other stationary 
solutions of the Vlasov equation. Its main interest is its mathematical simplicity since it 
possesses properties of homology in continuity with the isothermal distribution [34] . 

Polytropic distribution functions can also emerge in a different context. For example, 
Silva & Alcaniz [24] and Du Jiulin [48] assume that the dynamics of their system is governed 
by a generalized Boltzmann equation admitting a H-theorem for the Tsallis entropy [31]. In 
that case, the polytropic distribution is the only stationary solution of this kinetic equation. 
However, the relevance of this generalized kinetic equation for astrophysical systems remains 
to be established (Silva & Alcaniz and Du Jiulin do not mention to which systems their 
approach applies). Furthermore, as shown in Chavanis [14], it is possible to construct even 
more general kinetic equations that increase a larger class of "generalized entropies" than 
the one proposed by Tsallis. Consequently, it has to be explained why Tsallis entropy 
should be selected among other functionals of the form S = — J C(f)d 3 rd 3 v. Concerning 
the theoretical study of self-gravitating polytropic spheres, our results differ from those 
obtained by Silva & Alcaniz [24]. A first difference is that we define the kinetic temperature 
by T = p/p = (| J fv 2 d 3 v)/ f fd 3 v = \{v 2 ) while they use g-expectation values. Another 
important difference is that we consider an inhomogeneous medium while Silva & Alcaniz 
consider a homogeneous system. In particular, they derive a distribution function of the 
form 



instead of Eq. (66). Our generalization is important because gravitational systems are in- 
homogeneous. Thus, the equation of state associated with Tsallis distribution is that of a 
polytrope p = Kp 1 while the approach of Silva & Alcaniz [24] gives the impression that the 



artifact of their homogeneity assumption. In fact, for inhomogeneous self-gravitating sys- 
tems, the kinetic temperature associated with a polytropic distribution is space-dependent, 




(69) 



equation of state is isothermal with a generalized g-temperature: p 
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see Eq. (56). Therefore, the stability condition given in [24] based on the sign of the spe- 
cific heat is not correct. The stability of polytropic spheres must take into account spatial 
inhomogeneity as discussed in [22, 32]. 

Du Jiulin [48] considers inhomogeneous distribution functions of self-gravitating systems 
described by Tsallis statistics. However, his approach is unnecessary complicated because 
he did not realize at the start that the stationary distribution function must be a function 
of the individual energy e = y + $(r) alone. Indeed, for the class of generalized mean- field 
kinetic equations considered in [14], and written symbolically as 

where C is a convex function determining the equilibrium state, a stationary solution must 
cancel independently the advective term and the collision term. The cancellation of the 
advective term implies that / is a stationary solution of the Vlasov equation. This is 
satisfied by any / = F(e) where F is arbitrary. Then, F is determined by the collision term 
by requiring Qc{f) — (see [14] for more details). We stress that the stationary solution 
/c(e) of the kinetic equation (70) only depends on the energy e while the Vlasov equation 
admits a much larger family of stationary distributions. This can also be seen by noting that 
the kinetic equations in [14] increase a generalized entropy functional S = — J C(f)d 3 rd 3 v 
at fixed mass and energy. Therefore, the stationary state maximizes S at fixed E, M and 
this implies / = /c*( e )- When S is the Tsallis entropy, this directly leads to Eq. (62) given in 
Chavanis [14] while Du Jiulin postulates the form (66) as an extension of the homogeneous 
distribution (69) given in Silva & Alcaniz [24]. He then obtains Eq. (61) by a laborious 
perturbative calculation while this relation is exact and results almost immediately from 
Eq. (62). In addition, Du Jiulin argues that this relation provides an analytic expression 
of the g-parameter. This is not the logical way of reading this relation. The relation (61) 
is just a property of a polytropic distribution function with index q, not an explanation 
of the meaning of Tsallis g-parameter. Equation (61) is not mysterious (nor fundamental) 
once the physical meaning of the temperature is given. In our approach, T(r) represents the 
usual kinetic temperature related to the density and pressure via T(r) = p(r)/p(r). Said 
differently, Eki n = \p(v 2 ) = \pT is the local density of kinetic energy. Since p(r) and p(r) 
are functions of the gravitational potential 3>(r), see Sec. HID, this implies that T(r) is a 
function of $(r). This is true for any distribution function of the form / = /(e). Now, for 
a polytropic distribution, T(r) = p(r)/p(r) = i^p(r) 7-1 where p($(r)) is explicitly given by 
Eq. (52). This directly leads to Eq. (61) stating that T is a linear function of <3> in that case. 



V. A THIRD INTERPRETATION: QUASI-EQUILIBRIUM STATES OF A "COL- 
LISIONAL" DYNAMICS 

In a recent numerical study, Taruya & Sakagami [33] find that the transient stages of 
the collisional relaxation of the iV-stars system confined within a box can be fitted by a 
sequence of polytropic distribution functions with a time dependent q(t) parameter. This 
is an interesting result which contrasts from the King's sequence (truncated isothermals) 
applying to tidally truncated stellar systems. Therefore, in their latest works [33], Taruya 
& Sakagami interpret polytropic distributions as quasi-equilibrium states of a "collisional" 
dynamics. However, this is essentially an out-of-equilibrium result so that the connec- 
tion with Tsallis thermodynamics is not clear. In particular, the evolution of stellar clus- 
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ters is usually described by the orbit-averaged-Fokker-Planck equation which exploits the 
timescale separation between the dynamical time and the relaxation time. It is possible 
that the time dependent solutions of the orbit-averaged-Fokker-Planck equation can be fit- 
ted by g(t)-distributions although this equation is based on standard statistical mechanics 
and satisfies a H-theorem for the ordinary Boltzmann entropy, not for the Tsallis entropy. 
Therefore, the results of Taruya & Sakagami [33] tend to disfavor Tsallis thermodynam- 
ics instead of establishing it: indeed, g(t)-polytropes can emerge from a kinetic equation 
based on standard thermodynamics (Boltzmann H-theorem). In addition, it seems unlikely 
that g(t)-polytropes are exact solutions of the orbit-averaged-Fokker-Planck equation, so 
that they represent more a convenient fit for the solutions of a complicated nonlinear time 
dependent partial differential equation than a fundamental outcome of a "generalized ther- 
modynamics". Furthermore, it is not clear whether they attract all the solutions of the 
orbit-averaged-Fokker-Planck equation or if their "basin of attraction" is limited to some 
particular initial conditions. Finally, it is not clear whether the interpretation of polytropic 
distributions functions given by Taruya & Sakagami [33] as quasi-equilibrium states of a 
collisional dynamics extends to other systems with long-range interactions such as the HMF 
model for example. These are important questions to consider. In any case, the numerical 
experiments of Taruya & Sakagami [33] fill the gap between the description of the "violent 
relaxation" (first stage) and the description of the "gravothermal catastrophe" (ultimate 
stage) of stellar systems. 

VI. CONCLUSION 

We have discussed three distinct interpretations of Tsallis functional S q [f] in astrophysics. 
Most discussion has been devoted to Vlasov-Poisson systems. Systems with long-range in- 
teractions spontaneously form "coherent structures" that are not described in general by 
the Boltzmann distribution. This is the case for galaxies in astrophysics, vortices in 2D 
turbulence and quasi-stationary states in the HMF model. Two types of interpretation 
have been given to describe these structures. In the "generalized thermodynamical inter- 
pretation" [20, 21, 22, 23, 24, 25, 26, 27, 28], the metaequilibrium states are viewed as 
generalized statistical equilibrium states. The maximization of the Tsallis entropy S q [f] at 
fixed mass and energy provides a condition of generalized thermodynamical stability. In 
the "dynamical interpretation" given here and in [8, 18, 19], the metaequilibrium states are 
particular stationary solutions of the Vlasov equation. Any DF / = /(e) with f'(e) < 
extremizes a certain functional S[f] — — J C(f)drdv, called a H-function, at fixed mass and 
energy. The condition of maximum is a criterion of nonlinear dynamical stability via the 
Vlasov equation. These two interpretations are physically different. However, formally, the 
criterion of nonlinear dynamical stability for collisionless stellar systems described by the 
Vlasov equation resembles a criterion of thermodynamical stability in the microcanonical 
ensemble and the criterion of nonlinear dynamical stability for barotropic stars described 
by the Euler equation resembles a criterion of thermodynamical stability in the canonical 
ensemble. We have used this "thermodynamical analogy" to provide an original interpreta- 
tion of the Antonov first law in terms of ensemble inequivalence. However, the resemblance 
with a thermodynamical formalism is effective. 

In this paper, we have not discussed how a collisionless stellar system described by the 
Vlasov-Poisson system can reach a quasi-stationary distribution (meta-equilibrium) and 
what determines this metaequilibrium state. This is discussed in [2, 10] based on the concept 
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of phase mixing and violent relaxation introduced by Lynden-Bell [9] in 1967. As a result 
of a mixing process, the coarse-grained distribution function /(r, v,t) achieves a stationary 
state on a very short timescale (of the order of a few dynamical times) while the fine-grained 
distribution function f(r,v,t) develops intermingled filaments at smaller and smaller scales. 
Lynden-Bell tried to predict the optimal metaequilibrium state by using statistical mechan- 
ics arguments. This prediction is complicated because we have to deal with an infinite 
number of constraints (Casimirs). Therefore, the coarse-grained distribution function aris- 
ing from the statistical theory of violent relaxation is non-Boltzmannian in general [8]. It 
can be viewed as a sort of superstatistics [10]. In the dilute limit of his theory, Lynden-Bell 
[9] predicted an isothermal distribution / ~ e~^ . He also understood that his prediction 
fails for high energies (corresponding to extended orbits) due to the complicated problem 
of incomplete relaxation: the systems tends to reach the statistical equilibrium state (most 
mixed) but cannot attain it because the fluctuations of the gravitational field, which are 
the engine of the relaxation, rapidly die away. This is why other stationary solutions of the 
Vlasov equation can emerge in practice corresponding to partially mixed states leading to 
confined structures. This kinetic confinement can be understood by developing dynamical 
models of violent relaxation [49, 50]. The metaequilibrium state reached by the system as 
a result of incomplete violent relaxation is very difficult to predict because it depends on 
the efficiency of mixing. It is different in general from Tsallis' distribution (pure polytrope) 
[14]. For example, stellar polytropes do not provide good models of galaxies [3]. A better 
model is a composite model [8, 51] with an isothermal core (n — oo, q — 1) justified by 
Lynden-Bell's theory of violent relaxation and a polytropic halo (n — 4, q — 7/5) resulting 
from incomplete relaxation. In this context, we have proposed to interpret the q parameter, 
which can vary in space, as a measure of mixing [8]. These general concepts also apply to 
2D vortices in hydrodynamics [2] and to the HMF model [18, 19]. 

We note that the maximization problem (26) determining the nonlinear dynamical stabil- 
ity of collisionless stellar systems is consistent with the phenomenology of violent relaxation 
[8, 9, 15]. Indeed, the H-functions H[f] — — J C(f)d 3 rd 3 v calculated with the coarse-grained 
distribution function /(r, v,t) increase with time (-H decreases), a property similar to the 
H-theorem of thermodynamics, while the energy and the mass remain approximately con- 
served. However, contrary to the Boltzmann equation, the Vlasov equation does not single 
out a unique H-function and the increase of the H-functions is not necessarily monotonic. 
Because of this generalized selective decay principle [10], we may expect the system to achieve 
a metaequilibrium state which maximizes one of the H-functions (non universal) at fixed 
mass and energy. This is consistent with the criterion of nonlinear dynamical stability (26) 
provided that we interpret the distribution function as the coarse-grained distribution func- 
tion. It is remarkable that these two maximization principles are consistent although they 
have a very different physical content (there is no notion of "dissipation" in the first while 
this lies at the heart of the second due to coarse-graining). Plastino & Plastino [20] correctly 
made the link with H-functions but they also gave the impression that Tsallis functional is 
special because of its thermodynamical properties. In addition, Plastino & Plastino [20] did 
not explain why we have to maximize the Tsallis functional. This is important because, as 
discussed above, this maximization problem is related to nonlinear dynamical stability, not 
thermodynamical stability. In particular, the notion of normalized g-averages (as done in 
paper III of [22]) is not relevant to settle the nonlinear dynamical stability of collisionless 
stellar systems. 

In conclusion, our discussion shows that the notions of dynamics and thermodynamics 
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are intermingled. There are lot of analogies (formal or real) and differences. This is a 
little bit similar to the wave/particle duality in quantum mechanics, each aspect having 
been defended by different schools. The coherent structures that form in long-range systems 
have both dynamical and thermodynamical (mixing) properties. We think, however, that 
the correct description of quasi-equilibrium states is, fundamentally, in terms of nonlinear 
dynamical stability arguments. Indeed, a collisionless stellar system can be trapped in 
a steady state of the Vlasov equation that does not satisfy the "thermodynamic-looking" 
criterion (26). The maximization principle (26) leads to DF of the form / = /(e) with /'(e) < 
depending only on energy so that it only characterizes spherical stellar systems which 
seldomly occur in nature. Now, there exists stationary solutions of the Vlasov equation, 
consistent with the Jeans theorem [3], that do not depend on the energy alone. This is the 
case for most observed stellar systems. In that case all the analogies with thermodynamics 
break down. This "problem" does not occur for ID systems such as the HMF model because 
/ = /(e) is the general form of stationary solutions of the Vlasov equation for these systems. 
The case of stellar systems is therefore interesting with respect to ID systems to show the 
limitations of the "effective" thermodynamical formalism. In conclusion, the dynamics and 
thermodynamics of systems with long-range interactions is rich and complex. We have given 
a lengthy discussion of these concepts in [2, 8, 10, 14, 29, 32]. In summary, we come to the 
following scenario: 

1. The rapid emergence of coherent structures in stellar dynamics (galaxies), two- 
dimensional turbulence (jets and vortices) and in the HMF model (quasi- stationary states) 
can be explained by a theory of incomplete violent relaxation based on the Vlasov or Euler 
equation, see [2]. Formally, the Vlasov equation is obtained when the N — > +oo limit is 
taken before the t — > +oo limit. 

2. The H-functions H[f] calculated with the coarse-grained distribution function /(r, v, t) 
increase, while the energy E[f] and the mass M[f] are conserved [15]. 

3. Due to violent relaxation and phase mixing [9], the coarse-grained distribution function 
/(r, v,t) converges toward a steady state /(r, v) which is a stationary solution of the Vlasov 
equation. The convergence takes a few dynamical times, independent on N. The fine-grained 
distribution /(r, v,t) develops filaments at smaller and smaller scales and does not achieve 
a steady state (presumably) . 

4- If mixing is complete, /(r, v) is given by Lynden-Bell's theory of violent relaxation 
[9]. It is in general a non-standard (non Boltzmannian) distribution depending on the initial 
conditions through the Casimirs. It can be viewed as a form of superstatistics [10]. 

5. If mixing is incomplete, the Lynden- Bell prediction fails (by definition!) since /(r, v) 
is only partially mixed. Incomplete relaxation [9] can be explained by dynamical models of 
violent relaxation which involve a diffusion coefficient that vanishes in certain regions of 
phase-space and for large times [49, 50]. 

6. Since /(r, v) results from a complicated mixing process, it is a nonlinearly dynamically 
stable stationary (i.e., robust) solution of the Vlasov equation. The general form of station- 
ary solutions is given by the Jeans theorem [3]. We emphasize that, in theories of violent 
relaxation, we must view the steady distribution function as the coarse-grained DF. It is in 
general very difficult to predict the state actually reached by the system in case of incomplete 
relaxation as it depends on the efficiency of mixing which itself depends on the "route to equi- 
librium" (dynamics). It does not appear to be explained by the generalized thermodynamics 
introduced by Tsallis in an attempt to describe non-ergodic behaviours [10, 11]. 

7. ///(r, v) = /(e) with J (e) < ; which is a particular case of the Jeans theorem, it ex- 
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tremizes a H-function at fixed mass and energy [15]. Furthermore, the condition of maximum 
is a condition of nonlinear dynamical stability [8]. In that case, we can develop a thermo- 
dynamical analogy [8, 14] to investigate the nonlinear dynamical stability problem, but all 
the notions of thermodynamics are formal or effective. Furthermore, this thermodynamical 
analogy can describe only spherical stellar systems with f — /(e) and /'(e) < 0. 

8. Tsallis functional S q [f] is the H-function corresponding to stellar polytropes which 
form a particular class of spherical collisionless stellar systems that are steady solutions of 
the Vlasov equation [8, 14]- 

9. For t — > +oo ; the system tends to relax toward a statistical equilibrium state de- 
scribed by the Boltzmann distribution. Formally, the collisional statistical equilibrium state 
is obtained when the t — > +oo limit is taken before the N — > +oo limit. In the case of 
stellar systems, the convergence to equilibrium is hampered by the escape of stars and the 
gravothermal catastrophe (see the Introduction). 

10. For intermediate collision times, the evolution of the system is described by the orbit 
averaged Fokker-Planck equation [3]. The DF passes by a sequence of quasi- equilibrium 
states f(e,t) which are quasi- stationary solutions of the Vlasov equation slowly evolving in 
time due to close encounters (finite N effects). In some cases of box confined systems, this 
sequence is well-approximated by stellar polytropes with a time dependent index [33]. 

We have also discussed another, completely independent, interpretation of Tsallis func- 
tional in relation with generalized kinetic equations. In this context, Tsallis functional S q [f] 
is a generalized entropy taking into account "hidden constraints" acting on the underlying 
dynamics of the system. We do not reject the possibility that this generalized thermodynam- 
ical approach can be relevant to certain self-gravitating systems (not stellar systems) but 
we stress that the interpretation of Tsallis functional (Sec. IV) is then completely different 
from the one given for Vlasov systems (Sec. Ill) [32]. Furthermore, as shown in [14], this 
generalized thermodynamical formalism (and related kinetic theories) can be extended to a 
larger class of functionals than the one proposed by Tsallis. 
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In this paper, we only consider the functional S q [f]. The important distinction between the 
functionals S q [f] and S q [p] is further discussed in [10]. 

As discussed in the Introduction, the convergence to the Boltzmann distribution function 
is hampered by the escape of stars and the gravothermal catastrophe. Even if we consider 
idealized situations of box confined systems with energy larger than the Antonov threshold so 
that local entropy maxima exist in theory, the dynamical convergence to these states is not 
clearly understood. Elaborate kinetic theories of self- gravitating systems taking into account 
memory effects and spatial derealization [38] do not admit a H-theorem and do not show 
the convergence toward the Boltzmann distribution (nor to any other simple distribution). 
Related problems are also encountered in the kinetic theory of point vortices [39]. 
Strictly speaking, the //-functions are defined with the coarse-grained distribution function 
/(r,v,i). We shall argue in the Conclusion and in [10] that, in case of violent relaxation, 
it is the coarse-grained distribution that is a nonlinearly dynamically stable stationary solu- 
tion of the Vlasov equation. Therefore, in all the paper, / must be regarded in fact as the 
coarse-grained distribution function /. Naturally, the stability results also apply to a steady 
distribution function / (fine-grained), but this supposes that the system has been initially 
prepared in such a stationary solution of the Vlasov equation, which is relatively artificial. 



26 



